MindStudio Insight is a visualization tuning tool for Ascend developers. It supports system, operator, serving, and memory tuning, enabling developers to quickly tune performance in training, inference, and operator development scenarios.
MindStudio Insight provides various tuning analysis methods, displays real software and hardware running data, analyzes performance bottlenecks from multiple dimensions, and supports visualized performance analysis for clusters with hundreds and thousands of cards, and even beyond, enabling developers to complete performance tuning within days.
MindStudio Insight allows developers to view the profile data in the cluster scenario on the Timeline tab page, displays the data by single card, and automatically traverses all .db, trace_view.json files (in PyTorch and MindSpore scenarios), and msprof.json* files (in TensorFlow and offline inference scenarios) in the input path. They do not need to manually merge files.
With the database, MindStudio Insight supports large-scale profile data processing, analysis of 20 GB cluster profile data, and performance tuning in foundation model scenarios.
MindStudio Insight supports system, operator, serving, and memory tuning, and visualizes the data for display, enabling developers to quickly tune performance.
System Tuning
MindStudio Insight provides the timeline view, memory, operator duration, and communication bottleneck analysis to allow developers to quickly locate model performance bottlenecks and perform in-depth tuning.
[object Object]undefined
Operator Tuning
MindStudio Insight provides the instruction pipeline view, operator source code view, and operator running load analysis view to display the key performance metrics of operators running on the Ascend AI Processor in a visualized manner, helping developers quickly locate software and hardware performance bottlenecks of operators and improve operator performance analysis efficiency.
[object Object]undefined
Serving tuning
MindStudio Insight displays the end-to-end request execution in the timeline view, showing the duration of the request in each key phase and the status of the request. This helps users quickly identify service performance bottlenecks and adjust the tuning policy accordingly.
[object Object]undefined
Memory Tuning
MindStudio Insight displays the detailed memory allocation on the device in graphics, and marks the usage details of various memory allocations based on the Python call stack and custom dotting tags to locate and optimize memory problems.
[object Object]undefined
MindStudio Insight allows you to import and display profile data files in various formats and provides suggestions and restrictions on file specifications.